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1  Attendees 

•  Jen  Golbeck  (UMD) 

•  Ugur  Kilter  (UMD) 

•  Jim  Hendler  (RPI) 

•  John  O’Donnovan  (UCSB) 

•  Tobias  Hollerer  (UCSB) 

•  Yolanda  Gil  (ISI) 

•  Chris  Hazard  (NC  State) 

•  Minindar  Singh  (NC  State) 

•  Michael  Reiter  (UNC) 

•  Ronald  R.  Yager  (Iona) 

•  Felix  Wu  (UC  Davis) 

•  Cliff  Wang  &  ARO  researchers 

2  Researcher  Presentations 

Slides  from  all  presentations  are  included  as  appendices  to  this  report.  Below 
is  a  summary  of  the  issues  raised  by  the  participants. 

2.1  Cliff  Wang 
Discussion  Goals 

1.  How  is  this  topic  multidisciplinary?  Be  specific. 

2.  Why  is  this  topic  basic  research  and  not  technology  development? 

3.  What  scientific  understanding  is  lacking  in  this  topic  area? 

4.  Why  has  that  understanding  not  been  obtainable?  What  are  the  dif¬ 
ficulties? 

5.  What  recent  scientific  breakthroughs  or  accomplishments  that  would 
now  enable  us  to  do  so? 
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6.  Why  more  research  is  needed  to  achieve  that  understanding? 

7.  By  what  criteria  will  the  research  be  judged  to  be  successful? 

3,  4,  5  are  particularly  important.  What  are  the  fundamental  things  we 
need  to  achieve? 

Information  used  to  come  from  sensors,  but  now  it  comes  from  a  combi¬ 
nation  of  sensors  and  humans,  and  there  is  contradictory  information.  More 
and  more  information  is  coming  in  from  social  interactions.  How  do  you 
make  a  decision?  What  is  a  scientific  method  for  doing  that? 

Can  we  trace  information  back  to  the  origin?  (This  raises  the  provenance 
question) 

2.2  Ron  Yager 

Title:  Fuzzy  and  Soft  Technologies  for  Trust 

Many  aspects  of  social  trust  computing  require  the  processing  of  informa¬ 
tion  that  is  imprecise,  uncertain  and  subjective  which  can  benefit  from  the 
use  fuzzy  and  other  soft  computing  technologies.  The  focus  of  our  talk  will 
be  on  the  role  that  fuzzy  sets  and  other  soft  granular  technologies  can  play 
in  furthering  trust  modeling  and  research.  We  shall  describe  an  extension  of 
social  network  modeling  that  uses  fuzzy  sets  to  build  a  bridge  between  the 
types  of  linguistic  terms  which  humans  use  to  communicate,  reason,  and  un¬ 
derstand  and  the  formal  representation  of  the  social  networks.  This  allows 
for  the  human  linguistic  articulation  of  trust  related  concepts  to  be  trans¬ 
lated  into  computational  manageable  mathematical  objects.  An  important 
task  in  trust  computing  is  aggregation,  this  occurs  both  in  the  determina¬ 
tion  of  reputation  as  well  as  in  path  based  process  of  determining  trust  via 
social  network  connections.  We  describe  a  number  of  semantically  based 
aggregation  tools  developed  in  the  soft  computing  framework  and  discuss 
the  applicability  to  trust  computing.  These  will  allow  one  to  process  lin¬ 
guistically  expressed  measures  of  trust  in  addition  to  numeric  ones.  Closely 
related  to  this  is  the  technology  of  linguistic  summaries  that  allows  one 
to  formulate  and  manipulate  statements  such  as  ”In  most  cases  John  is  a 
highly  trustworthy  partner.”  We  shall  briefly  discuss  the  paradigm  of  par¬ 
ticipatory  learning  which  can  provide  a  framework  for  context  based  trust 
determination. 

2.3  Mike  Reiter 

Title:  Leveraging  Community  for  Usable  Security 
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The  proliferation  of  always- connected  mobile  devices  permits  one’s  com¬ 
munity  to  be  reached  at  nearly  any  moment.  We  will  present  ideas  for  using 
this  pervasive  community  presence  to  manage  security  policies,  to  exercise 
one’s  authority,  and  to  protect  the  security  of  one’s  own  information.  Part  of 
this  talk  will  draw  from  our  experience  with  Grey,  a  system  we  have  deployed 
on  two  university  campuses  to  enable  users  to  leverage  their  mobile  devices 
for  exercising  and  delegating  authority  to  physical  and  virtual  resources. 

2.4  Felix  Wu 

Title:  ’’SCOSK:  Social- Centric  Operating  System  Kernel” 

In  this  short  talk,  I  will  discuss  the  possibility  of  pushing  social  infor¬ 
matics  into  the  Operating  System  kernel,  mainly  for  the  purpose  of  cyber 
security.  We  will  first  go  over  a  few  cyber  events/attacks  as  motivation  ex¬ 
amples.  Then,  we  will  discuss  the  benefits  of  managing  social  resources,  as 
a  first-class  citizen,  inside  an  OS  kernel.  Finally,  if  time  allows,  we  will  go 
over  a  few  technical/research  challenges  in  realizing  SCOSK. 

2.5  Munindar  Singh 

Title:  Trust  Middleware  as  a  Basis  for  Social  Computing 

Recent  research  into  trust  has  yielded  approaches  that  consider  evidence, 
incentives,  cognitive  states,  and  social  relationships. 

But  the  key  aspect  of  trust  that  underlies  the  above  approaches  is  itself 
largely  ignored.  Specifically,  trust  reflects  a  dependence  of  one  agent  on  an¬ 
other  for  a  purpose.  The  mutual  dependence  of  agents  and  their  successes 
or  failures  pertaining  to  it  may  be  reflected  in  social  relationships,  expressed 
cognitively,  motivated  by  incentives,  or  recorded  in  evidence.  But  the  repre¬ 
sentation  and  reasoning  about  dependence  is  a  central  concern  that  merits 
serious  study. 

Based  on  the  above,  we  motivate  a  trust  middleware  as  a  central  logical 
component  for  social  computing.  The  middleware  would  assist  agents  by 
bookkeeping  their  trust  relationships.  It  would  help  realize  application- 
specific  architectures  that  support  diverse  social  computing  applications, 
such  as  those  involving  personal,  communal,  organizational,  and  contractual 
relationships. 

2.6  Ugur  Kuter 

Every  day,  people  and  organizations  exchange  information  and  make  deci¬ 
sions  through  networked  entities.  Sometimes  the  nodes  of  these  networks 
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may  be  other  people  or  organizations;  sometimes,  they  are  communication 
hubs,  Internet  servers,  or  software  agents.  In  any  case,  the  activities,  goals, 
and  plans  of  any  entity  depend  on  the  trust  and  credibility  of  the  networked 
entities  and  the  information  they  spread  across  the  network.  Such  notions 
of  trust  and  credibility  also  affect  how  certain  events  happen  in  the  world, 
which  are  not  under  control  of  the  decision-making  agent.  Thus,  it  is  im¬ 
portant  to  understand  how  agents  or  groups  of  agents  use  resources  in  the 
world,  how  they  produce  information  based  on  those  resources,  and  how 
those  resources  determine  their  plans,  activities,  and  goals  over  time.  To 
date,  social  dynamics  in  networks  have  been  largely  neglected  in  systems 
that  help  to  make  decisions  under  spatial  and  temporal  constraints.  I’ll  de¬ 
scribe  some  background  and  the  works  we’re  doing  currently  at  UMd  in  this 
specific  research  topic.  I’ll  then  summarize  several  future  directions. 

2.7  Chris  Hazard  (presented  by  Minindar  Singh) 

Title:  Trust  and  Incentives:  Dynamics  and  Strategy 

Abstract:  In  multiagent  interactions,  such  as  e-commerce  and  peer-to- 
peer  file  sharing,  being  able  to  accurately  assess  the  trustworthiness  of  other 
agents  is  important  for  agents  to  protect  themselves  from  losing  utility.  We 
focus  on  an  agents’  discount  factors  (time  preference  of  utility)  as  a  direct 
measure  of  the  agent’s  trustworthiness  in  a  number  of  settings.  We  prove 
that  an  agent’s  discount  factor,  when  in  context  of  the  agent’s  valuations 
and  capabilities,  is  isomorphic  to  trustworthiness  for  a  set  of  reasonably  gen¬ 
eral  assumptions  and  definitions.  Further,  despite  the  large  body  of  work  in 
reputation  and  trust  in  dynamic  multiagent  environments,  no  metrics  exist 
to  directly  and  quantitatively  evaluate  and  compare  reputation  systems.  We 
present  a  common  conceptual  interface  for  reputation  systems  and  a  set  of 
four  measurable  desiderata  that  are  broadly  applicable  across  multiple  do¬ 
mains,  inspired  by  dynamical  systems  theory.  We  discuss  the  implications, 
strengths,  and  limitations  of  our  desiderata.  Our  discount  factor  trustwor¬ 
thiness  model  performs  well  across  the  desiderata  when  measured  against 
other  established  reputation  models  from  the  literature.  We  briefly  conclude 
with  some  preliminary  work  extending  our  dynamics  and  strategy  perspec¬ 
tive  into  the  dimensions  of  signaling  and  sanctioning  as  a  way  of  designing 
and  assessing  trust  systems. 
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2.8  John  O’Donovan 

Based  at  the  Four  Eyes  Lab,  Dept,  of  Comp  Science,  University  of  California 
Santa  Barbara,  the  WiGis  project  centers  around  visualization  of  large- 
scale,  highly  interactive  graphs  in  a  user’s  web  browser.  Our  software  is 
delivered  natively  in  your  web  browser  and  does  not  require  any  plug-ins 
or  add-ons.  Our  method  produces  clean,  smooth  animation  in  a  browser 
through  asynchronous  data  transfer  (AJAX),  and  access  to  rich  server  side 
resources  without  the  need  for  technologies  such  as  Flash,  Java  Applets, 
Flex  or  Silverlight.  We  believe  that  our  new  techniques  have  broad  reaching 
potential  across  the  web.  Below  is  a  windowed  version  of  the  system. 

The  WiGis  framework  has  been  applied  as  a  solution  in  a  diverse  set  of 
scientific,  social,  computational  and  other  systems  that  require  user  inter¬ 
action  with  networked  data.  Please  see  the  left  menu  for  some  examples 
and  live  demos,  or  click  the  button  below  to  examine  the  core  framework  on 
some  static  data. 

2.9  CTA  discussion 

The  trust  research  taking  place  in  the  Army’s  centers  for  network  science  is 
a  vast  undertaking.  Nearly  all  of  the  attendees  are  affiliated  with  the  CTA 
effort.  A  discussion  of  the  research  areas  covered  in  the  different  centers  and 
cross-cutting  research  initiatives  identified  topics  being  covered  and  those 
not  addressed  by  the  centers.  The  following  research  questions  are  currently 
not  part  of  the  work  taking  place  under  CTA: 

1.  Non- network  centric  work  -  Since  the  CTA  is  focused  on  network  sci¬ 
ence,  non-network  related  trust  issues  are  outside  that  domain.  Of 
particular  interest  to  the  workshop  attendees  are  behavioral  and  lin¬ 
guistic  trust  models.  Behavioral  models  in  particular  are  part  of  a  rich 
research  history  that  has  new  applications  to  the  wealth  of  data  from 
online  social  interactions.  A  sub-topic  discussed  in  this  area  is  the 
motivation  to  trust.  What  causes  people  to  trust  and  what  do  they 
see  as  its  benefits? 

2.  Dynamics  of  trust  -  This  topic  addresses  how  do  trust  values  change, 
if  forgiveness  is  considered,  the  changing  justifications  for  trust  levels, 
etc.  Trust  dynamics  are  of  interest  to  many  groups  but  are  not  well 
studied,  so  this  is  a  question  with  lots  of  potential. 

3.  Distrust  /  negative  trust  -  There  have  been  a  few  studies  on  distrust 
or  negative  trust  values,  but  it  is  problematic  to  use  in  many  models. 
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However,  like  trust  dynamics,  it  is  an  issue  of  great  interest  to  the 
military  and  to  trust  researchers. 

4.  Trust  risk  model  -  A  security  model,  where  trust  is  bad  and  security 
can  be  compromised  is  quite  different  from  a  social  model  where  trust 
is  good  because  it  helps  with  decision  making  and  where  risk  is  not 
as  clearly  defined.  Looking  at  the  overlap  between  these  tracks  of 
research  is  an  open  space  and  may  lead  to  some  interesting  integrations 
of  theories. 

5.  Use  of  game  theory  -  Trust  and  game  theory  fit  well  together  and  there 
is  extensive  literature  on  the  topic.  It  is  still  an  active  area  of  work 
where  new  results  are  being  produced,  and  this  is  not  a  topic  of  study 
in  the  CTA. 

3  Ideas  for  Future  Trust  Research 

After  the  presentations  and  discussions  presented  above,  we  discussed  twelve 
areas  that  emerged  as  spaces  for  future  work.  Each  topic  discussion  was  led 
by  a  workshop  attendee  whose  name  is  indicated  parenthetically  next  to  the 
topic.  In  the  section  below,  each  topic  is  described  with  possible  research 
areas.  Where  appropriate,  extra  attention  is  given  to  the  questions  raised 
above  by  Cliff  Wang  regarding  the  research  that’s  missing,  why  we  can  do 
it,  and  what  the  impact  will  be. 

3.1  Dynamics  of  trust 

(Jinghe  Cho,  Munindar) 

How  does  trust  change  over  time?  What  are  the  roles  forgiveness,  for¬ 
getfulness,  regretfulness?  How  quickly  do  a  person’s  actions  propagate  and 
affect  trust  that  others  have  in  them?  How  does  that  affect  others  in  the 
network? 

There  are  countless  questions  related  to  the  dynamics  of  trust,  and  it  is 
an  area  where  there  was  a  lot  of  enthusiasm  at  the  workshop. 

On  a  system  level,  there  are  issues  of  how  the  system  impacts  trust  among 
users,  how  trust  is  represented,  and  how  trust  values  are  updated.  Algorith¬ 
mically,  there  are  questions  about  how  trust  dynamics  are  represented  in 
algorithms  and  how  changes  propagate  through  the  network. 

Finally,  there  are  behavioral  issues  related  to  how  dynamics  affect  and 
are  affected  by  social  structure  and  social  groups. 


This  area  of  trust  dynamics  touches  on  many  of  the  open  areas  not 
covered  by  CTA,  and  is  one  that  the  workshop  attendees  saw  as  a  space 
that  many  of  us  could  do  work. 

3.2  Trust/risk  model 

(Kevin) 

Trust  is  a  relationship  that  people  use  to  mitigate  risk.  However,  the 
study  of  risk  itself  is  of  interest  to  better  understand  trust.  Furthermore, 
as  mentioned  above,  risk  plays  an  important  part  in  security  discussions, 
and  this  is  a  space  where  social  and  security  oriented  risk  discussions  can 
come  together.  Research  topics  in  this  space  include  the  impact  on  decision 
making,  uncertainty  management,  time  sensitivity  of  decisions  with  respect 
to  trust,  and  methods  for  minimizing  risk  and  optimizing  decision  making. 

3.3  Linguistics 

(Presented  by  Ron,  Chris) 

The  use  of  language  for  understanding  trust  has  potential,  particularly 
in  the  area  of  ontologies,  topic  modeling,  and  applications  of  LDA. 

We  discussed  using  computational  linguistics  as  a  mechanism  for  weight¬ 
ing  trust,  and  for  extracting  trust  from  statements. 

Linguistics  also  have  potential  for  revealing  why  people  have  trust  in 
others.  It  provides  insight  into  personal  interpretation  of  people  and  events 
that  lead  to  trust.  The  technologies  to  pursue  this  work  now  exist,  but  they 
have  not  been  extensively  applied  to  study  trust. 

3.4  Human  Behavior  and  Trust 

(Ugur) 

Studying  the  relationship  between  human  behavior  and  trust  is  a  wide 
open  space  for  research.  Looking  at  observed  behavior  -  do  actions  indicate 
trusting  or  untrusting  behavior  -  can  be  studied  in  many  ways.  Computa¬ 
tional  social  science,  game  theory,  using  controlled  experiments  with  users, 
and  observing  their  behavior  are  all  methods  for  doing  research  in  this  space. 

Behavior  and  trust  will  also  touch  on  questions  of  background  and  cul¬ 
ture,  which  is  of  particular  interest  to  military  applications.  It  will  also 
cover  questions  of  impersonation,  deception,  and  lying. 
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3.5  Trust  aggregation  and  inference 

(Ron,  Ugur) 

Trust  inference  is  one  of  the  more  widely  studied  areas  of  trust.  There  are 
a  number  of  algorithms  published  and  implemented  in  systems.  However, 
there  are  many  questions  left  to  be  studied  in  this  area.  To  date,  there 
is  no  research  on  how  to  combine  trust  values  from  different  sources,  how 
to  allow  user  control  over  algorithmic  functions  (e.g.  should  people  have 
personalized  trust  scales,  could  and  should  trust  aggregation  functions  vary 
between  users). 

Evaluation  of  these  algorithms  is  also  not  standardized,  partially  because 
of  the  lack  of  public  trust  datasets.  If  a  BAA  is  to  encourage  research  in  this 
space,  evaluation  should  be  encouraged  and  datasets  should  be  provided  to 
allow  direct  comparison  of  performance  between  algorithms. 

3.6  Engineering  trust  systems 

(Munindar) 

While  most  of  our  discussions  focused  around  theoretical  and  scientific 
research  questions  related  to  trust,  there  was  limited  interest  in  the  engi¬ 
neering  of  systems.  Munindar,  who  lead  this  discussion,  raised  issues  of 
a  trust  middleware,  centralized  trust  systems,  and  the  ability  to  use  trust 
across  systems.  This  is  a  very  different  topic  than  the  rest  suggested  by  the 
workshop  attendees,  but  could  be  an  interesting  area  for  research  if  a  more 
engineering  /  system  building  approach  is  desirable. 

3.7  Properties  of  trust  systems 

(Felix  Wu) 

Related  to  the  engineering  of  trust  systems,  but  a  topic  that  received 
a  more  enthusiastic  response,  is  that  of  properties  of  trust  systems.  This 
includes  understanding  global  properties,  like  robustness  (including  anti¬ 
manipulation  /  stabilization),  achieving  consensus,  preserving  diversity  and 
protecting  minorities,  confidentiality,  accountability,  and  incentives  for  par¬ 
ticipation. 

Robustness  brings  us  to  issues  of  attack  resistance.  In  trust  systems, 
that  will  include  somewhat  traditional  attack  strategies,  like  collusions,  but 
also  questions  of  how  social  influence  or  reputation  can  be  exploited  to  take 
advantage  of  others  in  the  network.  On  the  flip  side,  study  of  offensive 
strategies  for  disrupting  trust  networks  falls  within  this  area.  This  is  useful 
for  learning  how  to  protect  a  network  and  for  harming  adversaries. 
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3.8  Leveraging  trust  in  systems 

(Mike) 

One  of  the  main  reasons  for  studying  and  understanding  trust  is  to  use 
it  in  applications.  While  there  has  been  some  study  of  the  effectiveness  of 
trust  in  applications,  there  is  a  lot  of  exciting  work  to  be  done  in  this  area. 
Application  spaces  where  trust  is  used  to  improve  other  systems  include 
recommender  systems,  trust  in  automation,  and  information  filtering  and 
personalization.  Trust  can  also  be  reapplied  to  social  systems;  strengthening 
interactions,  recommending  relationships,  and  investigating  the  connection 
between  trusting  individuals  and  groups  are  all  important  research  questions 
with  many  open  problems. 

3.9  Communication  of  trust 

(John) 

Once  trust  is  used  in  applications,  it  may  appear  in  back  end  systems 
like  recommender  systems  or  on  front-end  interface  elements  that  indicate 
how  trustworthy  a  person  or  their  content  is.  For  users  to  take  advantage  of 
the  trust,  there  are  questions  of  how  (if  at  all)  trust  should  be  communicated 
to  the  end  user  and  how  users  provide  trust  information  to  the  system. 

Research  on  communication  of  trust  includes  studying  what  is  the  right 
amount  of  trust  to  communicate  to  users  (black  box  models  vs.  transpar¬ 
ent  models)  and  how  entities  in  the  system  exchange  information  with  one 
another.  Research  in  this  space  will  also  allow  comparison  and  performance 
differences  between  various  trust  models  more  easily. 

3.10  Distrust 

(Jen) 

Distrust  is  an  understudied  question  in  this  area.  During  the  workshop, 
we  raised  a  number  of  research  issues  including  propagation  and  representa¬ 
tion  of  distrust.  However,  while  the  workshop  attendees  recognized  this  as 
an  important  topic,  there  was  little  enthusiasm  for  this  as  an  emerging  area. 
Part  of  the  reason  it  is  not  well  studied  now  is  that  the  unaddressed  issues 
are  quite  complex  and  difficult  to  work  with  properly.  Some  argued  that  it 
may  be  impossible  to  use  distrust  in  more  than  a  very  simple  way.  We  felt 
it  was  unlikely  that  a  BAA  would  lead  to  much  progress  on  this  topic. 
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3.11  Context  of  trust  - 

(Ron) 

Context  is  an  issue  that  is  constantly  raised  in  discussions  of  trust.  It  is 
certainly  an  important  issue,  as  both  the  meaning  of  trust  and  its  treatment 
in  algorithms  and  models  will  vary  as  context  changes.  However,  while  we 
all  recognized  that  it  was  important,  there  were  no  real  research  questions 
that  emerged  nor  enthusiasm  about  this  as  a  topic  for  the  BAA. 
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OS  Kernel 
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•  It's  all  about  resources 

-  CPU  Cycles,  Memory,  File  System,  I/O 
Bandwidth... 

-  Application  Processes! 

•  Allocation  and  Abstraction 

-  "Fairness/Efficiency" 

-  “Provenance" 

•  How  do  the  SCOSK  protect  the  core  value 
of  the  SI  against  aggressive  applications? 
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“Should  I  have  faith  in  you?” 


FAITH  (Facebook  Application  Identifier  Translator  &  Hypervisor) 
like  NAT  (Network  Address  Translation) 
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Social  Network  Transformation 


UC  DAVIS 

UNIVERSITY  OF  CALIFORNIA 


•  Each  application  might  need  different  OSN 
topologies. 
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•  Managing  Social  Resources 
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•  Let  “users"  (or  community  of  users)  define 
and  control  their  social  needs. 

•  And,  the  impact  of  VPSN  to  the  backbone 
OSN  or  other  VPSN  needs  to  be  carefully 
managed,  (open  problem) 

-  Currently,  we  only  provide  “CSI  isolation" 
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" God  bless  you  in  2010 ,  the  Sabbath  Year  before  the  Jubilee. " 


New  Email  names  for  vou! 

Get  the  Email  name  you've  always  wanted  on  the  new  @ymail  and  @rockctmail. 
Hurry  before  someone  else  docs! 


//. 
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UC  DAVIS 

UNIVERSITY  OF  CALIFORNIA 


Re:  My  present  condition  please  help  me  out  of  this  problem!!!!!!!!!!!!!!!!!!! 

-  \^  .\A  B  ^  ^  §>.  0  ©  a  a.  a  .  - 

Get  Mail  Write  Address  Book  Reply  Reply  All  Forward  Tag  Delete  Junk  Print  Back  Forward 

Subject:  Re:  My  present  condition  please  help  me  out  of  this  problem!!!!!!!!!!!!!!!!!!! 

From:  Tj  Hsieh  ▼ 

Date:  3/2/10  8:49  AM 
To:  S.  Felix  Wu  ▼ 

Mtcn  is  the  confirmation  number  giving  by  western  union  body  in  order  for  you  to  withdraw  your  money 
worldwide.  I 

Reply 

—  On  Tue,  3/2/10,  S.  Felix  Wu  <wu@cs. ucdavis.edu>  wrote: 

From:  S.  Felix  Wu  <wu@cs.ucdavis.cdu> 

Subject:  Re:  My  present  condition  please  help  me  out  of  this  problem!!!!!!!!!!!!!!!!!!! 

To:  "Tj  Hsieh"  <tjhsech_taiwan@ yahoo ,com> 

Date:  Tuesday,  March  2, 2010, 4:44  PM 


What  is  MTCN? 


Tj  Hsieh  wrote: 

>  i  can  not  received  any  bank  transaction  because  there  no  check  book  wfith  me  here  and  i  advices  to  check  any  nearby 
western  union  office  or  outlet  around  you  send  the  money  to  the  information  will  get  here... 

> 

> 

>  Here's  my  info  below 


▲ 

▼ 


A 
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How  to  build  the  trust? 


UC  DAVIS 

UNIVERSITY  OF  CALIFORNIA 


•  If  only  I  have  some  social  relationship 
information  available... 
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nno 


Facebook 


•>IZ 


D  http://www.facebook.com/?ref=home 


C  Qj  Google 


Facebook 


Facebook  I  FarmVille 


Chien-Ke  La n 
Edit  My  Profile 


ID  News  Feed 

^  Messages  (28) 
^  Events 
1(3]  Photos 
Ik  Friends 

•§§  Applications 
@  Games 
More 

Chat  with  Friends 
Go  Online 


tD  News  Feed 


What's  on  your  mind? 


S.  Felix  Wu 


Top  News  •  Most  Recent 


S.  Felix  just  found  some  Treasured  Cornish  Mystery  Eggs  and 
wants  to  say  thank  you! 

S.  Felix  just  harvested  their  chicken  coop  and  found  some 
Treasured  Cornish  Mystery  Eggs,  and  wants  to  thank  their  friends 
for  feeding  the  chickens! 


£  3  hours  ago  via  FarmVille  Comment  Like  Hatch  an  egg 
SHOW  4  SIMILAR  POSTS 


Leeann  Sunnycalb 


Wow!  A  Treasured  Scots  Grey  Mystery  Egg  was  just  found! 

Leeann  just  hatched  a  rare  mystery  egg  and  found  some  Treasured 
Scots  Grey  Mystery  Eggs,  and  wants  to  give  10  friends  a  chance  to 
hatch  one  too! 

They  want  to  share  one  with  you  but  hurry!!  There  are  only  a  few 
left! 


fa  49  minutes  ago  via  FarmVille  Comment  Like  Hatch  an  egg 

Deejay  Thibado  acts  like  spam  -  wants  you  give 
permissions  and  'like'  button 

48  minutes  ago  *  Like 


r 


Leeann  Sunnycalb  scam  u  have  to  do  a  survy  &  give 
them  your  cell  # 

44  minutes  ago  •  Like 


Write  a  comment... 


Events  See  All 

What  are  you  planning? 
m  Birthdays:  Mei  Yeoh,  Meng  He  Lin 

Suggestions  See  All 

Heart  Cherry  X 

Reconnect  with  him. 

^9  Write  on  his  Wall 


Sponsored 


Create  an  Ad 


Netflix  -  Try  free  today  X 

You've  heard  of 
Netflix,  now  try  us 
for  free! 


iS  Like 


Requests 


See  All 


[HI  1  group  invitation 
ifa  1  farmv  lie  gift  request 
[3  2  650  farmville  cash  ( invitations 
2  other  requests 

Get  Connected 

(Sjj>  Who’s  on  Facebook? 

Find  your  friends 

tg  Who’s  not  on  Facebook? 

Invito  thorn  nnuu _ 

^  yyJ  1*  Chat  (Offline) 
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Facebook  |  Chien-Ke  Lan 

+  E  http://www.facebook.com/profile.php?id=100000880093751 

I  " 


◄  |  ► 

Facebook  I  Chien-Ke  Lan 


C  Q?  Google 


Facebook  I  FarmVille 


mKKEMKM I 

Edit  My  Profile 

FBR  (Facebook  Ranger) 

Information 

Relationship  Status: 

It's  Complicated 

Birthday: 

June  30,  1971 

Friends 

541  friends 


See  All 


a*a 


Lee  Han 
Kim 


Rainbow  Wai  Hung 
King  Yeung 


Chien-Ke  Lan 

Wall  Info  Photos  $H;£3E  RUffftOnline  Notes  + 


What's  on  your  mind? 
Attach:  BSl  *0*  [51  ▼ 


Share 


Chien-Ke  Lan 


Options 


Wow!  A  Treasured  Scots  Grey  Mystery  Egg  was  just  found! 

Chien-Ke  just  hatched  a  rare  mystery  egg  and  found  some 
Treasured  Scots  Grey  Mystery  Eggs,  and  wants  to  give  10  friends  a 
chance  to  hatch  one  too! 

They  want  to  share  one  with  you  but  hurry!!  There  are  only  a  few  left! 


^  6  minutes  ago  via  FarmVille  A  Comment  Like  Hatch  an  egg 


Chien-Ke  Lan 


Chien-Ke  was  working  in  the  stables! 

Chien-Ke's  horses  were  so  helpful  on  their  farm,  Chien-Ke  was  able 
to  get  Arborists  to  help  them!  Ch... 

See  More 


about  an  hour  ago  via  FarmVille  A  Comment  Like  Get  Help  on  Your  Farm 


Chien-Ke  Lan 


Remove 

Chien-Ke  just  found  some  Treasured  Golden  Mystery  Eggs  and 
wants  to  say  thank  you! 

Chien-Ke  just  harvested  their  chicken  coop  and  found  some 
Treasured  Golden  Mystery  Eggs,  and  wants  to  thank  their  friends  for 
feeding  the  chickens! 


fa  about  an  hour  ago  via  FarmVille  A  Comment  Like  Hatch  an  egg 


Create  an  Ad 


Connect  in  more 


places 


FastAccess®  DSL  Lite  with 
Wi-Fi  included  keeps  you 
connected  in  more  places. 
Act  now  and  get  3  months 
Free.  S19. 95/mo.  Order 
now. 

Like 

Sacramento  Almost  x 
Free 


«N* 

75%  off  smoothies?  A  one 
hour  massage  for  S30?  A 
sunset  cruise  for  S20?  See 
today’s  Sacramento  deal! 

iS  Like 


iPad  up  to  75%  off  x 

_ fl .  _ i _ 

!•  Chat  (Offline) 


Display  a  menu  for  “http://www.facebook.com/apps/application.php?id  =  130529466968382^ 
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I  ▲ 
▼ 

A 


UC  DAVIS 

UNIVERSITY  OF  CALIFORNIA 


5^jf  Lee  Han 
Kim 


Rainbow  Wai  Hung 
King  Yeung 


Chien-Ke  just  found  some  Treasured 
wants  to  say  thank  you! 

Chien-Ke  just  harvested  their  chicken  coc 
Treasured  Golden  Mystery  Eggs*  and  warn 
feeding  the  chickens! 

^  about  an  hour  ago  via  FarmV'ijie  A  Comment  •  Like  *  Ha 


_ jt _ 

r  “http;/ Avivw/acebock.con/aops/appficat  ion. pho?id  =130529465968352 
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i  TrnAuic 


Facebook  |  FarmVille 


http://www.facebook.com/apps/application.php?id=130529466968382&v=infc 


C  (Q^  Google 


L  _  .  .  J 


Co  to  Application 


Add  to  my  Page 
Suggest  to  Friends 
Block  Application 


Information 


Category 

All 


FarmVille 


®  Like 


Wall  Info  Reviews  Discussions 


About  FarmVille 


Friends  using  this  Application 
No  friends  are  using  this  application. 
About  the  Developer 


Bill  Barrelli 


This  application  was  not 
developed  by  Facebook. 


!•  Chat  (Offli 


Gamers  Unite! 


UC  DAVIS 

UNIVERSITY  OF  CALIFORNIA 


GflmeRS  unne  ■ 

Place  to  share  Facebook  Carnes  Tips 


Custom  Search 


Welcome  Di! 

profile  friends  logout 


&  FARMVILLE  DISCUSSIONS  @  MY  FEED  nelu!  *f  GET  GIFTS  O  ADD  ME  WRITE  A  NEW  POST 


You've  been  added  to  the  list!  Please  add  at  least  3  folks  from  the  list  to  be  your  friends 


FarmVille 


Add  yourself  or  add  others  who  want  to  play  FarmVille!! 


Eh  n 

Di  Ji  Piotr  K^tny  Elene  Seri  Sonia  Cheesman 


2802 


Ben  Den  rip 


Howdy  Ya’ll!  Come  on  down  to  the 
Farm  today  and  play  with  your 
friends.  We  got  plenty  of  land  for 
everyone.  Come  and  see  what 
everyone  is  hootin'  and  hollerin' 
about. 


«*m«its 

UflITC  ! 


Gamers  Unite!  on  Facebook 
Like 


Marilyn  Gonzalez 


Leslie  A  Schlak 


Desiree  Collewijn 


Raanan  Sokolov 


Tracy  Hill 


Gamers  Unite!  Happy  Friday!  Farmville's 
latest  update,  better  snag  bar  prefs  and  a 
new  hack  from  Rich  Smith... 

http://bit.ly/dbNht8 
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How  to  build  the  trust? 


UC  DAVIS 

UNIVERSITY  OF  CALIFORNIA 


•  If  only  I  have  some  social  relationship 
information  available... 
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UC  DAVIS 


Social-Enabled 
Applications 
and  Games 


Name-ID 

resolution 

Community 

Oriented 

Keywords 

Policy/Reputation-based 
Route  discovery 

SCOSK  over  OSN 


- Data  or  Address  □ 

. Integrity  bit  □ 

- Instruction  □ 
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COMMON  DATA  BUS 


UC  DAVIS 

UNIVERSITY  OF  CALIFORNIA 
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C SI:  College  Park 

Research  at  the  intersections  of  social  trust  networks, 
probabilistic  reasoning,  game  theory  and  planning 

Game  theory  Probabilistic 

Models 

Social  Trust 

Web  Service 

Composition  Social  Networks 


Web  Page  (under  construction):  www.csicp.org 


In  this  talk, 


How  to  make  decisions  and  act,  when 


you’re  working  on  a  physical  transportation  network, 
you’re  interacting  with  a  social  group, 

you  do  not  know  individual  tendencies  (e.g.,  altrusim, 
fairness,  individualistic)  in  the  group, 

you  do  not  know  the  group’s  collective  tendencies  (e.g. 
cooperativeness) . 


Outline 


Understanding  cooperativeness  in  groups 

Cooperativeness  as  a  measure  of  intentions  of  the  group 
Other  factors  that  go  into  intentions/objectives 
understanding? 

Ongoing:  Learning  how  to  adapt  to  an  adversarial  group 

Ongoing:  Dynamics  of  social  trust  relationships  among  a 
group  of  agents 

Among  humans  as  well  as  mixed  human/software  agent 
groups 

Evaluation  framework:  strategy  games 
Conclusions  and  Future  Work 


Understanding  Cooperativeness 


How  to  model  an  agent  behavior  in  a  social  environment? 

U 

How  to  define  the  cooperativeness  of  a  group? 


In  most  of  the  time,  we’re  living  in  a  Darwinian  society 
where  the  survival  of  the  fittest  is  the  prominent  rule 


Research  Questions: 

How  and  why  cooperative  behavior  emerges  given  that 
selfish  individuals  can  gain  by  taking  advantage  of  other? 


_ 


Evolution  of  Cooperation 

Existing  research  typically  utilize  games  for  modeling 
social  dilemmas  about  cooperating  and  defecting 
E.g.,  Prisoner’s  Dilemma  (PD) 


Prisoner’s  Dilemma 

Player  2 

Cooperate  (C)  Defect  (D) 

Player  1 

Cooperate  (C) 
Defect  (D) 

(3, 3)  (0, 5) 

(5,0)  (1,1) 

Played  only  once: 

Defect  (D)  always  provides  a  higher  individual  payoff 
But  mutual  cooperation  (C)  is  socially  optimal 
Played  repeatedly  for  an  unknown  number  of  times: 

Ii.e.,  Iterated  Prisoner  s  Dilemma  (IPD) 

Cooperative  behavior  (e.g.,  Tit-for-Tat)  might  emerge  to  increase 
accumulated  payoff 


Social  Valu<|  Orientation  (SVO)  Theory 

SVO  is  a  social  choice  theory  [Messick  and  McClintock  in 

1968] 

Based  on  empirical  evidence,  SVO  states  that: 

Individuals  vary  in  their  interpersonal  social  tendencies 

Individual's  behavior  may  often  be  motivated  not  only  by 
self-interest  but  also  by  the  consequences  for  the  others 

These  reflect  stable  and  consistent  orientations 


Our  ContrihutiQn^^GECCO-ioi  IAT-io) 

Proposed  a  new  model 

Based  on  Social  Value  Orientation  (SVO)  theory  in  social 
and  behavioral  science 

Explicitly  captures  the  notion  of  pro-social  vs.  pro-self 
orientations  exhibited  in  human  behavior 

Analyzed  steady  state  behaviors 

Provided  a  new  definition  for  cooperativeness  using  social 
orientation  of  players 

Independent  of  the  average  payoff  and  game  matrix 

Accurately  describe  some  situations  that  using  average 
payoffs  as  a  measure  of  cooperativeness  cannot 


Our  SVO-inspired  Model 


player  j  ’s 
total  payoff 


Social  orientation  (0j)  of 
Player  i 

A  model  of  the  player’s 
tendency  to  adopt  a  pro¬ 
social  or  pro-self  behavior 


player  i ’s  total  payoff 


Examples 


=  71/4  = 


>  individualistic 

>  fair 


=  tc/ 2  =>  altruistic 


Summary  of  results 


2x2  symmetric  same 

V  0 

Player  2 

Cooperate  (C)  Defect  (D) 

Player  1 

Cooperate  (C) 
Defect  (D) 

(R,R)  (5,T) 

(T,  S )  (P,  P) 

(WLOG,  assume  0j  <  0=) 


Both  players  are 
pro-self 
©i  <  45,  0j  <  45 


0i  +  0j  <  90  0j  +  0j  =  90  0j  +  0j  >  90 


Both  players  always 
defect  at  each  game 
in  steady  state 


Both  players  are 
pro-social 
©i  >  45,  Gj  >  45 

One  pro-self, 
one  prosocial, 
i.e., 

0;  <  45,  0j  >  45 


Both  players  always 
cooperate  at  each 
game  in  steady  state 


Pro-self  player  i  gets 
©j(T+S),  and  pro¬ 
social  player  j  gets 
(1-©i)(T+S)  at  each 
game  in  steady  state 


Player  1  gets 

-  SP-PT 

Pi  = 


(P-T)-(P-S) 


1=7- 


Player  2  gets 

-  _  -  1  — 

Pi  —P'—FT 


Player  1  gets 


Pi  =  Pj 


-  1  — r\ 


Player  2  gets 

-  _  TR-HS 

Pj  —  - 


T=T 


How  to  Define  the  Cooperativ:|ne§s?, 

Traditional  definition:  Average  payoff  obtained  by  players 
Higher  the  average  payoff,  more  cooperative  the  society 
May  not  be  accurate,  e.g.,  defecting  may  lead  to  high  payoff 
sometimes 

We  will  illustrate  it  in  the  following  experiments 

Our  definition:  Social  orientation  of  players 
0i  >  71/4  =>  Player  i  is  cooperative 

Cooperativeness  of  a  society  =  avg  0  or  %  of  cooperative 
agents 

Independent  of  the  average  payoff  and  game  matrix 


Experiments 

Investigate  emergence  of  cooperative  populations  based 
on  social  orientations  of  individuals 

Use  Evolutionary  Simulations 
Players  play  I  PD  with  each  other 
Replicator  dynamics 

each  player  has  a  number  of  offspring  that  is  proportional  to  its 
expected  total  payoff 

Initial  population 

Randomly  generated  10  0  values  from  the  interval  [o,  n/ 2] 

Size  of  a  group  with  a  particular  0  value  constitutes  10%  of  the 
entire  population 

Mutation 

On  average,  once  in  every  100  generations,  introduce  a  small 
amount  of  new  randomly-chosen  mutant  players 


%  of  cooperative  avg  theta  (in  rad)  avg  payoff 


2.5  3  3.5  4  4.5  5 

R 


2x2  symmetric  game 

Player  2 

Cooperate  (C)  Defect  (D) 

Player  1 

Cooperate  (C) 
Defect  (D) 

(R.R)  ( S.T ) 

(T.S)  (P,P) 

%  of  cooperative  avg  theta  (in  rad)  avg  payoff 

agents 


BaryingfH 


2x2  symmetric  game 

Player  2 

Cooperate  (C)  Defect  (D) 

Player  1 

Cooperate  (C) 
Defect  (D) 

{R,R)  (S',  T) 

(: T,S )  {P,P) 

Average  payoff  increases 
when  P  increases 

Average  0  drops  sharply  when 
P is  large 

Contradicts  with  the 
predictions  of  standard 
definition  of  cooperativeness! 
No  one-to-one  correlation 
between  the  average  payoff 
and  the  group’s 
cooperativeness 


15 


Importance  of  this  work 

Showed  the  advantage  of  using  social  orientation  of  players  and 
payoffs  as  a  metric  for  the  society's  cooperativeness  level 

However,  this  result  suggests  that  understanding,  game- 
theoretically,  the  dynamics  of  a  group's  behavior  has  some 
open,  interesting  issues 

While  previous  works  using  average  payoff  as  a  metric  of  the 
degree  of  cooperation  may  not  be  accurate  sometimes 
Next  slides  on  two  ongoing  works  on  social  trust  in  groups 


Trust  and  Credibility  in  Social  Groups 


We  will  define  and  implement  a  series  of  increasingly  complex 
games  that  involve 

information-gathering,  information-hiding,  negotiations  over 
physical  resources 

In  developing  these  games,  we  will  require  the  following 
features: 

Players  do  not  know  who  is  working  with  them  or  against  them,  so 
trust  is  initially  unknown. 

Players  must  interact  and  exchange  resources  (e.g.  money, 
information,  etc.)  so  there  are  bases  for  establishing  a  history  that 
will  influence  trust. 

Payoffs  will  depend  on  identifying  who  is  trustworthy,  so  players 
have  an  incentive  to  investigate  and  establish  trust  in  others. 

Objective:  analyze  the  game  data  to  understand  how  the  players 
develop  trust  in  each  other  and  how  their  trust  changes  over  the 
course  of  the  games 


There  are  three  good  players  and  one  bad  player. 

All  players  are  heading  to  the  center. 

The  bad  player  wins  if  he  gets  to  the  center  ahead  of  at  least  one  good  player. 

Otherwise  the  good  team  wins. 

Players  draw  cards  at  the  beginning  of  the  game  that  will  state  if  they  are  good  or  bad. 

Resources  and  requirements 

Resources  can  be  exchanged  between  players. 

They  can  be  traded,  given  away,  or  exchanged  with  promise  of  something  in  return  later. 
There  are  no  rules  to  prevent  players  from  lying  or  going  back  on  promises  -  anything 
is  fair! 


Til  Applet  Viewer:  gui.GameApplet.class 

v  /v  X 

1  Applet 

Game  Board 


Resources 


Neighborhood 


4 


x  3 
x  2 
x  4 


Notes 

Player  2  won't  share  his 
resources. 

Player  4  thinks  Player  3  is 
the  bad  guy. 


Trades 

Trade  With: 


You  Give: 


<5 


Reset 


Chat 


Player  1:  Hi  Everyone 
Player  2:  Hi,  Good  Luck! 

Player  3:  Can  anyone  give  me  a  red  resource? 
Player  4:  I  can't,  you  might  be  the  bad  guy 
Player  3:  No  I'm  not!  Maybe  you  are! 

Player  1:  I  need  a  green 


[Type  Here  to  Chat" 


You  Get: 


Offer  Trade 


Chat 


Status  Goes  Here 


Applet  started. 


Research  Objectives  and  Results 

Understand  how  trust  develops  between  people  in 
social  networks  that  change  over  time 

Build  computational  models  of  the  dynamics  of  trust  to 
guide  decision-making  and  acting 

Paper  in  preparation  for  CHI-11 


j 


Tmst  in  Social  Groups  with 
Hidden  Roles/Objectives 


Example: 

Two  groups  of  agents:  Orange,  Blue 

All  agents  interact  with  each  other  for  some  number  of  iterations 
^Orange  +  nBiue  agents;  each  agent  only  knows  its  role,  but  not  others’ 
One  can  guess;  but  cannot  be  100%  sure  until  the  end  of  the  game 

Winning  condition 

The  group  with  high  average  accumulated  payoff  wins  the  game 

Research  Question:  how  should  a  player  represent  and 
learn  to  adapt  its  trust  to  the  others  in  the  network? 


^  * 


Approach 


2-population  co-evolutionary  model 

“Gene”  =  initial  trust  value  +  trust-update  rules 

The  fitness  of  an  individual  is  computed  by  evaluating  the 
individual  against  a  number  of  individuals  from  the  other  group 

With  this  model,  evolutionary  computation  will  give  us: 
Automated  generation/simulation  of  agent  s  trust  models 
Improve  old  models  by  arm  race 

Learning  strategies  for  acting  based  on  trust,  from  adversarial 
behavior 

Were  currently  working  on  the  formalism  of  our  model  and 
algorithms,  and  are  implementing  the  setup  for  pilot  tests 


Conclusions 


Described  a  new  model  for  understanding  cooperativeness  in 
groups 

Cooperativeness  as  a  measure  of  intentions  of  the  group 
Other  factors  that  go  into  intentions/objectives  understanding? 

Ongoing:  Learning  how  to  adapt  to  an  adversarial  group 

Ongoing:  Dynamics  of  social  trust  relationships  among  a  group 
of  agents 

Among  humans  as  well  as  mixed  human/software  agent  groups 
Evaluation  framework:  strategy  games 

Future  work:  Develop  a  formalism  (Behavior  Network 
Diagrams)  to  analyze  the  above  factors  together 

Future  Work:  Using  BNDs  to  do  adversarial  planning/decision 
making 


JL 


Motivating, 
abstract  scenario 


Consider  a  humanitarian  group 
trying  to  deliver  supplies  to  a 
village  that  is  suffering  after  a 
natural  disaster. 


The  transportation  network  provides  many  options  for 
bringing  in  the  support: 

routes  for  helicopters,  trucks,  and  people  moving  on  foot 

Several  groups  of  people  interacting 
Relief  people,  Villagers,  Militia,  Others 


Importance  of  this  work 

Described  a  formal  model  with  insights  from  social  and 
behavioral  sciences 

Analyzed  the  steady  state  behaviors 

Showed  the  advantage  of  using  social  orientation  of  players  as  a 
metric  for  the  society's  cooperativeness  level 

While  previous  works  using  average  payoff  as  a  metric  of  the  degree  of 
cooperation  may  not  be  accurate  sometimes 

We  are  in  the  process  of  performing  more  extensive  evaluations 
of  this  controversial  result 

However,  this  result  suggests  that  understanding,  game-theoretically, 
the  dynamics  of  a  group's  behavior  has  some  open,  interesting  issues 
Next  slides  on  two  ongoing  works 
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Player  i  is  fair,  i.e.,  0;  =  45 
Player  j  is  random 


player  j  ’s 
total  payoff^  c] 

E[2,C] 

EJ? 


i  chooses  C  (j  chooses  D) 

g2  =  gi+  <0,  5>  =  <0,  5> 
i  chooses  D  (j  chooses  D) 

g3  =  g2+  Ui>  =  <i»  6> 

i  chooses  D  (j  chooses  C) 
g4  =  g3+  <5>°>  =  <6,  6> 
i  chooses  C 
Similar  to  Tit-for-Tat 


player  i  ’s  total  payoff 


2x2  symmetric  same 

v  O 

Player  2 

Cooperate  (C)  Defect  (D) 

Player  1 

V 

Cooperate  (C) 
Defect  (D) 

(H,R)  ( S,T ) 

C T,s )  (P,P) 

Five  possible  cases  for  each  game  in  steady  state: 

If  both  i  &  j  are  pro-self,  then  both  players  always  defect 
If  both  i  &  j  are  pro-social,  then  both  always  cooperate 
If  i  is  pro-social,  but  j  is  Pro-self,  then  Player  i  gets  r^T+S), 
and  Player  j  gets  (l-r^T+S) 


_ 


Results  confirm  the  previous  findings  in  Evolution  of 
Cooperation  (Axelrod  1980): 

Average  payoff  varies  between  P  and  R,  which  correspond  to 
full  defection  and  full  cooperation,  respectively 


Each  agent  keeps  track  of  trustworthiness,  t{,  of  other 
agents,  -1  <  t{  <  1 

Agent  2  has  ta  =  1  means  2  has  high  trust  in  agent  1 

i.e.,  agent  j  belief  that  agent  i’s  behavior  is  similar  to  its,  so  they  re 
in  the  same  team 

1  Agent  2  has  t2  =  -1  means  2  has  low  trust  in  1 

i.e.,  agent  j  belief  that  agent  i’s  behavior  will  against  agent  j’s  plans 


After  each  iteration,  is  updated  based  on  the  history, 
according  to  the  following  updating  rule 
H  ->  AtH,  where  H  is  the  history  of  interaction 
E.g.,  t2=o.i  and  <(C,C),...,(C,C)  )->  0.1,  then  t2  is  updated  to 
0.2  if  the  history  is  <(C,C),...,(C,C)  ) 


Related  work  on  modeling  agent  s 
behavior  9 

Game-theoretical  approaches 

Use  rationality  assumption,  i.e.,  maximizing  their  own  utility 

Several  models  for  evolution  of  cooperation 

Examples 

■  Lookup  table  e.g.,  [Axelrod  87] 

Probabilities  of  cooperation  e.g.,  [Nowak  and  Sigmund  93] 

Finite  state  automata  e.g.,  [Linster  92] 

Neural  networks  e.g„  [Harrald  and  Fogel  96] 

Most  of  them  did  not  explicitly  take  the  payoff  of  the  other 
player  into  account 

Research  in  social  and  behavioral  sciences 

E.g.,  Social  Value  Orientation  (SVO)  Theory 


Game  Play: 


There  are  three  good  players  and  one  bad 
player. 

All  players  are  heading  to  the  earth  at  the 
center. 

The  bad  player  wins  if  he  gets  to  the 
center  ahead  of  at  least  one  good 
player. 

Otherwise  the  good  team  wins. 

Players  draw  cards  at  the  beginning  of 
the  game  that  will  state  if  they  are  good 
or  bad. 

They  keep  these  cards  private  so  no  one 
truly  knows  the  goodness  or  badness  of 
other  players. 

At  the  beginning  of  each  round,  the 
players  each  roll  the  die. 

The  player  draws  the  number  of 
resource  cards  as  is  shown  on  the  die. 
All  players  roll  for  resources  in  all 
rounds,  even  once  they  have  reached 
the  center 


After  rolling,  players  draw  requirement 
cards  for  each  path  they  might  want  to 
cross. 


To  move,  a  player  must  turn  in  resource 
cards  to  pay  the  cost  of  the  path  they  will 
take,  and  they  must  show  the 
requirement  card  at  the  same  time.  All 
cards  go  into  a  discard  pile. 


Resources  can  be  exchanged  between 
players. 

They  can  be  traded,  given  away,  or 
exchanged  with  promise  of  something 
in  return  later. 

There  are  no  rules  to  prevent  players 
from  lying  or  going  back  on  promises 
-  anything  is  fair! 
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Trust-Based  Applications  and  Interfaces  for  the 

Social  Web 


John  O'Donovan, 

Dept,  of  Computer  Science.  University  of  California, 

Santa  Barbara. 


Workshop  on  Computing  with  Social  Trust,  University  of  Maryland,  College  Park.  July  29th  2010 


Outline 

"We  need  better  ways  to  model  and  represent  trust..." 


Past  Work... 

(At  University  College  Dublin,  and  Univ.  Southern  California) 

Trust  on  the  Social  Web  (PhD  Thesis) 

Example  Studies:  Trust  Modeling  for  Recommender  Systems 

Trust  Modeling  for  Online  Auctions 


Currently... 

(At  Univ.  of  California  Santa  Barbara) 

Trust-based  Interfaces  for  Recommender  Systems 
Interactive  analysis  of  trust  networks. 

Example:  SmallWorlds 

Next... 

Transparent  Trust  Models? 

Portable  and  Standardized? 

The  role  of  the  user  interface  for  trust  and  uncertainty  information. 
Linked  Data  &  semantic  web  solutions? 

Examples:  WiGis  and  WiGiPedia. 
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WHEN  IN  DOUBT— “LOOK  IT  UP”  IN 

The 

02* ncifclopaedia  jorita/wn ica, 

The  Sum  of  Human 
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44,000,000  words  of  text . 
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opaque  India  paper,  each 
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The  "Social"  Web  (aka  2.0| 

>f  ANSWERS 


Jniversity  of  California,  Santa  Barbara 

Center  for  Bioimage  Informatics 


vrnieo 


digg 


WikipediA 

The  Free  Encyclopedia 


Specialist 
applicatio  is 


Welcome  to  the  UCSB  Center  for  Bioimage  Informatics  Test  Bed  [  .  >  1 

Our  project  consists  of  applying  and  developing  pattern  recognition  and  I 
data  mining  methods  to  bio-molecular  images  to  fully  automate  both  the  I, 
extraction  of  information  from  those  images  and  the  construction  of  !  *  ?  1 

statistical ly-sound  models  of  the  processes  depicted  in  them.  public  images:  193: 

All  Images:  5603 

We  are  currently  developing  database  methods  for  large  sets  of  biological  2D  Planes:  127893 
images,  including  methods  for  processing  and  querying  raw  images.  Tags:  87407 

querying  and  combining  processed  metadata  and  bio-images  with  other  sources  of  biological 
data,  and  supporting  collaborative  access  over  the  shared  data  and  biological  models. 

I  Inter  the  public  image  collection 

Login  or  register  above  to  upload  private/public  images 
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Previous  Work  on  Trust. 


Trust  Model 

Trust 
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Model  2 

Visualization 

Ratings- 

(Ratings- 

Model  Pixel- 

Based) 

Based) 

Based) 

\  \ 

Attack  Strategies  / 

Reinforcement 

Problem: 

BoozerChooser 

Application 
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Application 


Trust  Propagation  / 
Personalisation 

AuctionRules 
application  for  eBay 


Example  1:  Modeling  trust  in  a  recommender  system. 


•Collaborative  filtering  algorithms  rely  too  heavily  on  profile  similarity. 


•Trustworthiness  of  users  is  an  important  factor  to  be  considered. 


•Trust  can  be  non-invasively  inferred  from  user  rating  histories. 


•Trust  values  can  easily  be  incorporated  into  the  mechanics  of  a  standard  collaborative 
filtering  algorithm  to  yield  better  robustness  and  predictive  accuracy  results. 


Standard  Collaborative  Filtering 


Trust-Based  Collaborative  Filtering 


Building  the  trust  model 


Trust1  (p,  i) 
Trustp(p) 


{( Ck,ik )  €  Correct  Set  (p)  :  ik  =  i} 
|{(cjk,4)  €  RecSet(p)  :  ik  =  i} 


\CorrectSet(p)\ 

\RecSet(p)\ 


Trust-Based  Collaborative  Filtering 


Example  2:  AuctionRules  Trust-mining  Algorithm 


Active  User  with  current 
Ebay  'trust'  score  of  375 


[  Search 


Advanced  Search 


>  Member  Profile 


Feedbacl 
Positive  Fee< 

Members  who  left  a  positive: 

Members  who  left  a  negative: 

All  positive  feedback  received: 

Learn  about  what  these  numbers  mean. 


recent  Ratings: 
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®  positive 
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Q  negative  1  1  1 
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Location:  United  States 

•  ID  History 

■  Items  for  Sale 

•  Add  to  Favorite  Sellers 


Bid  Retractions  (Past  6  months):  0 


[  Contact  Member  [ 


Text  reviews  expressing 
satisfaction  level  (Represented 
as  edge-value  in  trust  graph) 


Connected  nodes  in 
Active  user's  trust  graph 


Date /Time  Item# 
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Example  2:  AuctionRules  Trust-mining  Algorithm 


We  designed  a  lightweight  NLP  classification  algorithm 
specifically  for  extracting  the  polarity  of  sentiment  in  online 
auction  comments  on  eBay... 


Representing  the  Auction  as  a  Set  of  Features 


1 .  Item  -  The  quality/condition  of  the  product  being  bought 
or  sold,  (item,  product ) 

2.  Person  -  The  person  the  user  makes  the  transaction  with. 
(buyer:  seller,  e Bayer,  dealer) 

3.  Cost  -  Cost  of  item,  cost  of  shipping,  hidden  costs  etc. 
( expense ,  cost) 

4.  Shipping  -  Delivery  of  the  item,  security,  time  etc.  (de¬ 
livery,  shipping) 

5.  Response  -  Communication  with  the  other  party,  emails, 
feedback  comment  responses,  (response,  comment, 
email,  communication ) 

6.  Packaging  -  The  packaging  quality/condition  of  the  item 
packaging 

7.  Payment  -  how  the  payment  will  be  made  to  the  seller, 
or  back  to  buyer  for  return  (payment) 

8.  Transaction  -  the  overall  transaction  quality  (Service, 
Transaction,  Business) 
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Current  Work 


at  CS  Dept,  UCSB 

•  Broad  area  of  interactive  network  analysis  (with  trust  data)  for  social  web  and 
other  applications. 

Five  Ongoing  Projects: 

•  WiGi:  Web-based  Interactive  Graph  Interfaces 

•  WiGiPedia:  Interactive  visualizations  for  eliciting  trustworthy  semantic  data  in 
WikiPedia. 

•  SmallWorlds:  Interactive  Trust-based  recommender  system  for  Facebook. 

•  TopicNets:  Visual,  Interactive  and  Real-Time  Exploration  of  Topic-based  relations 
diverse  datasets. 


Provenance  Visualization:  Interactive  visualization  of  provenance  and  trust  data 
for  complex  scientific  process  flows 


WiGis  Framework: 


Scalable  Interactive  Visualization  of  >1M  networked  entities 
An  order  of  magnitude  more  scalable  than  the  next  best  web 
based  graph  tool 


Customizable 
Semantic 
Framework.  Map 
any  data  field-  (eg: 
Trust,  Similarity)  to  a 

Graph  Dimension 
Rich  search 

functionalities,  Node, 
Edge,  Group  and 
Shortest  Path 
Highlighting 


Native  in  all  major 
browsers,  with  no 
plugins  (flash,  java 
etc) 


Overview  and 
Zoom  Navigation 


Visualize  Remote 
algorithms  running 
on  local  data  in 
real  time 


Feature  Rich: 
Layout,  Clustering 
and  Interaction 
algorithms 

^  _  % 


Seamless  Transition  between  client  (local)  and  server  based 
(remote)  data  models.  Graph  representations  synchronized 
through  AJAX. 


’  Log  in  /  create  account 
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Pink  Floyd 


Pink  Floyd 


From  Wikipedia,  the  free  encyclopedia 

This  article  is  about  the  rock  band.  For  the  fictional  character,  see  Pink  Floyd  (fictional  character). 

Pink  Floyd  were  an  English  rock  band  who  earned  recognition  for  their  psychedelic  music  in  the  late  1960s,  and  as  they  evolved  in  the 
1970s,  for  their  progressive  rock  music.  Pink  Floyd’s  work  is  marked  by  the  use  of  philosophical  lyrics,  sonic  experimentation,  innovative 
album  cover  art,  and  elaborate  live  shows.  One  of  rock  music's  most  critically  acclaimed  and  commercially  successful  acts,  the  group  has 
sold  over  200  million  albums  worldwide,  including  74.5  million  certified  units  in  the  United  States 

Pink  Floyd  were  formed  in  1965.  and  originally  consisted  of  university  students  Roger  Waters,  Nick  Mason,  Richard  Wright,  and  Syd  Barrett. 
The  group  were  a  popular  fixture  on  London's  underground  music  scene,  and  under  Barrett's  leadership  released  two  charting  singles,  "Amok 
Layne"  and  "See  Emily  Play",  and  a  commercially  and  critically  successful  debut  album.  The  Piper  at  the  Gates  of  Dawn.  In  1968,  guitarist 
and  singer  David  Gilmour  joined  the  line-up,  and  Barrett  was  removed  due  to  his  increasingly  erratic  behaviour.  Following  Barrett’s  departure, 
bass  player  and  singer  Roger  Waters  became  the  lyricist  and  dominant  figure  in  the  band,  which  thereafter  achieved  worldwide  critical  and 
commercial  success  with  the  concept  albums  The  Dark  Side  of  the  Moon,  Wish  You  Were  Here,  Animals,  and  rock  opera  The  Wall. 

Wright  left  the  band  in  1979,  and  Waters  in  1985,  but  Gilmour  and  Mason  (joined  by  Wright)  continued  recording  and  touring  under  the  name 
Pink  Floyd.  Waters  used  legal  means  to  try  to  keep  them  from  using  the  name,  declaring  Pink  Floyd  a  spent  force,  but  the  parties  reached 
an  out-of-court  settlement  allowing  Gilmour,  Mason  and  Wright  to  continue  as  Pink  Floyd.  The  band  again  enjoyed  worldwide  success  with  A 
Momentary  Lapse  of  Reason  (1987)  and  The  Division  Bell  (1994),  and  Waters  continued  as  a  solo  musician,  releasing  three  studio  albums. 
Although  for  some  years  relations  between  Waters  and  the  remaining  three  members  were  sour,  the  band  reformed  in  2005  for  what  would  be 
a  final  one-off  performance  at  Live  8. 
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Pink  Floyd  in  1908  (from  left  to  right): 

Nick  Mason.  Syd  Barrett.  David  GSmour  (seated  in 
front).  Roger  Waters.  Richard  Wright 


Background  information 


Also  known  as  The  Tea  Set,  The  Pink  Floyd 
Sound,  The  Pink  Floyd 
Origin  London 

Genres  Progressive  rock 


Years  active 
Labels 


Associated 


1965-1996,  2005 


Sigma  6,  Joker's  Wild,  Zee 


www.pinkfloyd.co.uk 
www.pinkfloyd.com  [§> 


Former  members 


Syd  Barrett 
David  Gilmour 
Bob  Klose 
Nick  Mason 
Roger  Waters 
Richard  Wright 


All  structured  data  components 
visualization)  are  placed  in  the 


(infobox,  categories, 
same  vicinity 


Categories:  Pink  Floyd  |  Musical  groups  e 
1960s  music  groups  |  1970s  music  groups 
Capitol  Records  artists  |  Polar  Music  Prize 

stablished  in  1965  |  Musical  groups  disestablished  in  1996  |  English  progressive  rock  groups  |  Psychedelic  rock  music  groups  | 

;  |  1980s  music  groups  |  1990s  music  groups  |  Musical  quartets  |  Rock  and  Roll  Hall  of  Fame  inductees  |  Grammy  Award  winners  | 
i  laureates 

History 

[edit] 

Early  years  (1963-1967) 


[edit] 


Formation  [edit] 

Nick  Mason  and  Roger  Waters  met  at  the  Regent  Street  Polytechnic  in  London,  where  both  were  studying  architecture.!1!  The  pair  first  played  together  in  a  band  formed  by  Keith  Noble 
and  Clive  Metcalfe,  along  with  Noble's  sister  Sheilagh,  an  occasional  singer.  They  were  joined  later  by  fellow  student  Richard  Wright.  With  the  addition  of  Wright  the  band  became  a 
sextet,  and  took  the  name  Sigma  6J2!  Wright's  girlfriend  Juliette  Gale  was  often  a  guest  artist,  and  Waters  initially  played  rhythm  guitar  before  switching  to  bass.  Early  gigs  were  for 
private  functions,  and  the  band  rehearsed  in  a  tearoom  in  the  basement  of  Regent  Street  Polytechnic.  Sigma  6  played  songs  by  The  Searchers  as  well  as  material  written  by  fellow 
student  Ken  Chapman,  who  became  their  manager  and  songwriter. [2I 
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c)  All-Topic  Deformation 


b)  Single-Topic  Deformation 


Some  new  directions  for  this  work: 

•  Trust  and  Provenance  API  for  WiGis  Framework.  ... 
allowing  different  trust  models  to  plug  in  seamlessly, 
so  that  network  effects  can  be  visualized  and  the 
model  can  be  understood  more  easily. 

•  Promotion  of  this  interaction  framework  within  the 
community  of  trust  researchers. 

•  TopicTrust:  Using  LDA  techniques  to  infer  trust 
between  different  entities  though  their  topic 
relations,  (using  our  novel  and  fast  algorithms  from 
TopicNets) 


Research  Questions 

What  are  the  roles  of  both  interface  and 
interaction  in  trust-based  systems. 

How  does  transparency  introduced  by  the 
interface  change  the  user's  experience. 

Does  transparency  and  interaction  (dynamic 
provision  of  data)  effect  robustness  and 
stability  of  a  trust  based  system? 

How  can  Linked  Data  and  better  semantic 
relations  be  leveraged  to  build  a  reliable,  open 
and  portable  trust  model? 
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Personalizing  Trust  in  Online  Auctions 


John  O'Donovan  +,  Vesile  Evrim*,  Barry  Smyth+.  Dennis  McLeod*,  Paddy  Nixon+. 
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Motivations 


•Buyers  and  sellers  in  online  auctions  are  faced  with  the 
task  of  deciding  who  to  entrust  their  business  to  based  on 
a  very  limited  amount  of  information. 

•Over  99%  of  the  feedback  comments  left  on  eBay  are 
positive.  This  is  a  large  bias  and  can  be  misleading. 


Motivations 


•There  is  a  large  amount  of  hidden  negativity  in.  feedback 
comments 

•For  Example:  User  (a)  gives  a  positive  rating  for  a 
transaction  with  user  (b)  and  leaves  the  following:  “Nice 
Item,  but  shipping  was  too  expensive  and  the  item  was 
poorly  packaged” 

•This  scenario  occurs  frequently  on  auction  sites  such  as 
eBay  because  users  are  afraid  to  leave  negative 
comments  for  fear  of  retaliatory  negative  feedback. 
(Resnick  02) 


Main  Point 


•We  introduce  a  new  way  to  calculate  trust  for  online 
auctions  based  on  classification  of  user  feedback  and 
show  how  the  resultant  trust  can  be  tailored  for  different 
users. 


Background 


Gamon  et  al.  [3]  introduce  the  concept  of  varying  the  level 
of  granularity  during  the  classification  procedure,  finding  that 
"varying  the  level  of  granularity  of  analysis  allows  the  discovery 
of  new  information". 

Yukari  et  al.  (‘04)  Introduces  the  idea  of  salient 
satisfaction  factors  as  a  mechanism  for  classifying  negative 
comments. 

•Pang  and  Lee  (‘02)  Experiments  with  sentiment  classification  in  freetext 
comments.  Found  that  machine  learning  algorithms  generally  performed 
poorly  at  this  task. 


Extracting  Trust  from  Feedback  Comments 


Sub-Problem:  automatically  attaining  accurate 
classification  of  feedback  comments  into  +’ve  and  -’ve 

Solutions:  Machine  Learning? 

(no  specific  domain  knowledge  needed,  scalable,  portable  to 
different  auctions,  training  data...,  what  type  of  ML  algorithm  is  best? 

How  accurate/reliable??) 

Natural  Language  Processing? 

(domain  knowledge  required-  but  how  much?,  is  it  portable  to  other 
auctions  without  changing  the  domain  knowledge?  How  accurate?) 


NLP  Approach:  AuctionRules  Algorithm 


We  designed  an  NLP  classification  algorithm  specifically 
for  extracting  the  polarity  of  sentiment  in  online  auction 
comments... 


Representing  the  Auction  as  a  Set  of  Features 


1 .  Item  -  The  quality/condition  of  the  product  being  bought 
or  sold,  (item,  product ) 

2.  Person  -  The  person  the  user  makes  the  transaction  with. 
(buyer:  seller,  e Bayer,  dealer) 

3.  Cost  -  Cost  of  item,  cost  of  shipping,  hidden  costs  etc. 
( expense ,  cost) 

4.  Shipping  -  Delivery  of  the  item,  security,  time  etc.  (de¬ 
livery,  shipping) 

5.  Response  -  Communication  with  the  other  party,  emails, 
feedback  comment  responses,  (response,  comment, 
email,  communication ) 

6.  Packaging  -  The  packaging  quality/condition  of  the  item 
packaging 

7.  Payment  -  how  the  payment  will  be  made  to  the  seller, 
or  back  to  buyer  for  return  (payment) 

8.  Transaction  -  the  overall  transaction  quality  (Service, 
Transaction,  Business) 
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Trust  and  Incentives 

A  Dynamical  Perspective 


Munindar  P.  Singh 

(Joint  work  with  Christopher  J.  Hazard) 
singh@ncsu.edu 


North  Carolina  State  University 


Motivating  Question  and  Findings 

What  are  the  consequences  of  approaching  trust  from  the  standpoint  of  incentives? 


►  Natural  axioms  relating  trust  and  incentives 

►  Trustworthiness  maps  to  patience  (discount  factor) 

►  Reputation  models  as  mechanisms 

►  Govern  agents’  behaviors 

►  Can  be  analyzed  as  dynamical  systems 

►  Intuitive  desiderata  for  reputation  models  map  to  technical  properties 

►  Yield  a  principled  basis  for  comparing  existing  systems 

►  Contrast  with  traditional,  anecdotal  evaluations 
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Defining  Trustworthiness 


Scalar 

Preference 

Prefer  b  to  c  if  b  would  fulfill  more  costly 
commitment  than  c 

Strength 

Do  something  costly  =>  will  do  something 
cheaper 

Stability 

Preferences  stable  if  time  shifted 
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Intertemporal  Discounting  and  Its  Estimation 
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Trustworthiness  and  Discount  Factor  Isomorphism 

Proof  Sketch 


►  Compare  two  agents 

►  From  Preference  and  Scalar  properties,  examine  one  event 

►  Individual  rationality  =>  agent  expects  a  net  positive  utility  (future  utility 
from  relationship) 

►  If  b  will  fulfill  commitment  that  c  will  not,  b’s  perceived  utility  >  c’s 
perceived  utility 

►  Stability:  perceived  utility  inequalities  constant  multiplicative  factor,  xf 
(because  xt+s  =  xl  •  xs) 

►  x  can  break  inequalities  from  trustworthiness  definition  =>  x  related  to 
trustworthiness 

►  Utility  and  domain  of  x  match  standard  discounting 
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Trust  and  Reputation  Dynamics 


►  Agents’  utilities  are  functions  of  their  reputations 

►  Reputation  dynamics  with  strategic  agent 

►  Formalizing  key  desiderata 

►  Conceptual  interface  for  reputation  systems 

►  Update  function:  next  reputation  after  action 

►  Payoff  function:  reward  for  action  given  reputation 

►  Compare  reputation  systems 


Trust  System  Metrics:  Notation 


►  Agent  type:  6  G  © 

►  Current  reputation  (projection):  r  G  R 

►  Next  reputation  function:  ft 

►  r'  =  ftfl(r) 

►  Fixed  point  reputation  function:  x 

^  X(^)  =  li^n— >-oo  ^^(^initial) 


Dynamic  Reputation  Graphs 
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Ideal  Trust  System 
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Good  Trust  System 
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Trust  System  Metric  1:  Unambiguity 

Each  agent  type  asymptotically  maps  to  a  single  reputation  value 


Ambiguous  Trust  Systems 
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Trust  System  Metric  2:  Monotonicity 


►  Ideally  Patient  Strategic  (IPS)  agent 

►  Infinite  horizon,  maximize  utility 

►  If  6a  is  weakly  preferable  to  9 1,  to  IPS  agent  asymptotically,  as 
reputation  >  b's  reputation 


Trust  System  Metric  3:  Convergence 

Reputation  should  converge  quickly  near  the  fixed  point 

►  Max  component  of  gradient:  ||VQ(r)||00  <  1  and  minimized 

►  Lyapunov  stability  may  be  acceptable 


Divergent  Trust  Systems 


Trust  System  Metric  4:  Accuracy 

Minimize  average  error  over  distribution  of  types 

►  Error:  absolute  distance  from  ideal  reputation 

►  Reputation  system  performance  when  beliefs  far  from  fixed  point 
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Probabilistic  Reciprocity  Graph 

Probability  of  favor  based  on  balance  [Sen  2002] 
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Discount  Factor  Belief 


Discount  Factor  Graph 

Trustworthiness  ~  patience  [Hazard  &  Singh  2010;  Smith  &  desJardins  2009] 


Discount  Factor  Belief 
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Results 
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Convergence 
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no 

- 

1 

- 

Discount  Factor 

yes 
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►  Beta,  Certainty,  Travos  models  [J0sang  1998;  Wang  &  Singh  2006,  2007; 
Teacy  et  al.  2006] 

►  Probability  of  positive  and  negative  interactions 

►  Sporas  [Zacharia  &  Maes  2000] 

►  Reputation  measured  and  dampened 
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Next  Rating  (average) 
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Current  Rating 
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Conclusions  and  Directions 

Beginning  from  incentives  leads  naturally  to  dynamical  analyses 


►  Discount  factor  isomorphic  to  trustworthiness  given  assumptions 

►  Desiderata  are  first  major  step  in  comparing  diverse  reputation 
systems 

►  Discount  factor  model  performs  well,  does  not  yet  support  continuous 
choices 
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Trust  as  a  Basis  for  Social  Computing 


Munindar  P.  Singh 


North  Carolina  State  University 


Notions  of  Trust 

Existing  literature 


►  Subjective 

►  As  a  conglomerate  of  mental  attitudes 

►  Social 

►  Based  on  social  relationships 

►  Distributed 

►  Based  on  certificate  chains 

►  Measured  applied  to  the  above 

►  Based  on  heuristics,  probabilities,  utility, . . . 

Traditional  approaches  emphasize  estimation  over  meaning 


Applying  Trust  for  Social  Computing 

Trust  underlies  all  interactions  among  autonomous  parties 


►  Trust  reflects  the  trustor’s  dependence  on  the  trustee 

►  Currently,  trust  is  applied 

►  Embedded  into  each  specific  application 

►  Not  reusable 

►  Many  types  of  social  relationships,  each  nuanced 

►  Acquaintanceship 

►  Friendship 

►  Organizational 

►  Task-specific 

►  How  may  we  abstract  out  trust  to  apply  it  as  a  basis  for  social 
computing  applications? 


Programming  Social  Applications 

Approach 


Specify  and  configure 

►  Roles 

►  Social  interactions 

►  Their  effects  on  social  states 

►  Any  additional  constraints 


Programming  Social  Applications 

Middleware 


►  Offer  primitives  for  social  interactions 

►  Communicating 

►  Maintaining  social  state 

►  Computing  trust  on  behalf  of  a  participant 


Social  Middleware  to  Support  Social  Applications 
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:  Infrastructure  ) 
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V 

Architecture  Conceptually 

How  a  system  is  organized 


►  Primarily  its  ingredients 

►  Components 

►  Connectors 

►  An  architectural  style 

►  Constraints  on  components  and  connectors 

►  Patterns  on  components  and  connectors 


Architecture  Examples 

Components;  connectors;  constraints;  patterns 


►  Electrical  system 

►  Power  elements  (sources,  sinks);  conductors;  no  short  circuits;  star 

►  How  do  we  characterize  the  elements  and  conductors  logically? 

►  Current  drawn,  voltage  expected,  impedance  offered 

►  Social  system 

►  Individuals;  social  relationships;  ?;  ? 

►  How  do  we  characterize  the  individuals  and  their  relationships? 

►  Claim:  Trust  is  what  flows  over  a  relationship 

►  Can  we  characterize  relationships  in  a  reusable  manner,  even  though 
not  domain-independent? 


Social  Middleware  Related  to  Architecture 
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Understanding  Trust  in  Architectural  Terms 

General  Model  of  Trust 


►  Notions  of  dependence 

►  Conditional 

►  Compositional 

►  Semantic 

►  General 


Trust  from  a  Logical  Standpoint 


►  T  trustor, trustee{antecedent,  consequent) 

►  Lv/ce,Boi>(raise  alert,  send  warning) 

►  T trustor, trusteed ,  consequent):  unconditional  trust 

►  activate:  T x,y{r,  u)  A  r  ->  TX&(T,  u) 

►  T^,(CeiBob(raise  alert,  send  warning)  A  raise  alert 
=>  T Alice, Bob( T,  send  warning) 

►  complete:  u  -a  -T Xiy(r,  t/) 

►  send  warning  =>•  -'T/u/ceBob(raise  alert,  send  warning) 

►  send  warning  =>  ->T Alice, Bob(T,  send  warning) 

A  formal  semantics  underlies  the  above  notion 


Schematic  of  an  Architectural  Connector  as  Trust 
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Postulates  for  Trust 

Active  trust  basics 


(Omitting  trustor  and  trustee  when  they  are  the  same  throughout) 

►  Complete  a  connector:  dependence  has  been  fulfilled 

►  u  ->■  -iT (r,  u) 

►  Activate  a  connector:  make  dependence  stronger  (strongest  when 
r  =  T) 

►  T(r  A  s,  u)  A  r  -a  T(s,  u) 

►  Partition  a  connector:  a  dependence  for  two  things  is  a 
dependence  for  each  separately  (if  it  isn’t  already  done) 

►  T(r,  u  A  v)  A  ->u  T(r,  tv) 


Postulates  for  Trust 

Connector  integrity 


►  Avoid  conflict:  dependence  must  be  internally  consistent 

►  T(r,  u)-t-iT(r,->u) 

►  Nonvacuity:  dependence  must  be  for  something  tangible 

►  From  r  F  u  infer  -iT (r,  u) 

►  Tighten:  if  a  dependence  holds  then  a  narrower  dependence  also 
holds 

►  From  T(r, u),sb  r,s\f  u  infer  T(s, u) 


4  □  l>  4  0  <  =  >  <  .=  ^  '0  0,0 


singh@ncsu.edu  (NCSU) 


Trust  for  Social  Computing 


July  2010 


14/21 


Postulates  for  Trust 

Connector  structure 


►  Combine  antecedents:  two  connectors  with  the  same  consequent 
(fulfillment  condition)  yield  a  broader  connector 

►  T (r,  u)  A  T(s,  u)  ->  T (r  v  s,  u ) 

►  Combine  consequents:  two  connectors  with  the  same  antecedent 
(trigger  condition)  yield  a  stronger  connector 

►  T(r,  u)  A  T(r,  v)  ->■  T(r,  u  A  v) 

►  Chain:  two  chained  dependencies  yield  a  combined  dependence 

►  From  T (r,  u),  u  \-  s,T(s,  v)  infer  T(r,  v) 


Postulates  for  Trust 

Connector  meaning 


►  Exposure:  the  trustee’s  commitment  is  its  level  of  exposure  if  the 
trustor  trusts  it  for  it 

►  Cx>y(r,  u)  ->■  Ty,x(r,  u) 

►  Transient  alignment:  when  the  trustee  commits  to  support  the 
dependency 

►  Tx,y(r,  u)  ->  CyjX(r,  u) 

►  Well-placed  trust:  when  trust  is  fulfilled  in  the  actual  execution 

►  TX)y(true,  u)  ->  Ru 

►  Whole-hearted  alignment:  when  trust  is  backed  by  a  steady 
commitment  until  success 

►  TX)y(s,  v)  ->■  R(s^(Cy,x(s,  v)Uv)) 

(Above,  Cx>y(r,  u )  refers  to  a  commitment  from  x  to  y;  R  indicates  “on 
the  real  execution  path”;  and  pUg  means  p  holds  until  q  does) 


trustee’s  team,  Schematically 

If  you  trust  a  team  member,  you  trust  the  team 


- ► 


transient  alignment,  Schematically 

The  trustee  is  committed  to  what  you  trust  them  for 


◄  □  If-  ■<!  0  <  =  >  <  .=  ^  '0  0,0' 
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trustor’s  team,  Schematically 

Your  team  trusts  whom  you  trust 


■,  entails 

◄ - 
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parallel  teamwork,  Schematically 

If  you  trust  each  other,  you  are  part  of  a  team 


Directions 


►  Formalizing  architectures  for  social  computing  based  on  trust 

►  How  can  trust  fit  into  an  overall  system  architecture? 

►  Identifying  suitable  architecture  styles 

►  What  are  suitable  patterns  for  different  types  of  social  applications? 

►  Mapping  effectively  to  existing  representations  and  estimation 
techniques 

►  Computation  paths  can  be  used  as  a  basis  for  judging  probabilities 
and  expected  utilities 


Research  topics 

1)  Linguistics  translation  to  machine  understanding  (Ron,  Chris)  -2 

2)  Dynamics  of  trust  (Cho)  (Munindar)  4 

-  How  trust  changes  over  time? 

-  Forgiveness 

-  Regretfulness 

3)  Trust/risk  model,  impact  on  decision  making/uncertainty 

management  (Kevin)  2,5 

4)  Human  behavior  to  Trust  (context,  intention,  motivation,  cooperative 
vs.  self-centered,  reward/incentives)  (Ugur)  4 

5)  Trust  aggregation  and  inference  (Ron,  Ugur)  4 

6)  Distrust  (Jen)1.2 

7)  Property  of  trust  systems  (virtual  trust  plane)  (Felix)  3.5 

8)  Framework  for  integrating  and  leveraging  of  trust  relationship  (Mike) 
3 

9)  Engineering  of  trust  systems  (incentive)  (Munindar)  1 

10)  Communication  of  trust  (John) -3 


